SPECIFICATION 

Electronic Version 1 .2.8 
Stylesheet Version 1 .0 

A CMOS image sensor with a low- 
power architecture 

Background of Invention 

[0001] Overall power consumption may be extremely important in camera systems and 
other type systems which use Image sensors. Reduction of power consumption can 
prolong battery life, and can correspondingly allow smaller devices with smaller 
batteries or fewer batteries. However, there is often a direct trade-off between the 
amount of power that is consumed, and the quality of the image or images obtained 
by the sensor. 

Summary of Invention 

[0002] The present application teaches an Image sensor architecture with reduced power. 
According to an aspect, different areas of the image sensor are optimized separately, 
to save power. 

Brief Description of Drawings 

[0003] These and other aspects will now be described in detail with reference to the 
accompanying drawings, wherein: 

[0004] Figure 1 shows a basic block diagram of an active pixel sensor; 

[0005] Figure 2 shows a block diagram of the readout chain for an active pixel sensor; 

[0006] Figure 3 shows a single column parallel element; 

[0007] Figure 4 shows an alternative block diagram of a two level multiplexing block; 

[0008] Figure 5 shows a fully differential gain block with input and output isolation; 
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[0009] Figure 6A shows an alternative gain block and figure 6B shows a clocking system 
for this gain block; 

[001 0] Figure 7 shows a block diagram of a successive approximation A/D converter with 
an adjustable voltage reference; 

[001 1] Figure 8 shows a bias generation digital to analog converter; 

[001 2] Figure 9 shows a voltage reference generator; and 

[001 3] Figure 1 0 shows a block diagram of the registers used for carrying out digital 
timing. 

Detailed Description 

[001 4] Figure 1 shows a basic block diagram of a CMOS image sensor. The CMOS image 
sensor is functionally a number of different blocks. According to the present system, 
different areas of this CMOS image sensor may be optimized separately in order to 
save power. Specifically, the column readout, gain and output drive, may be separately 
optimized. 

[001 5] Block 1 00 includes the pixel array and its support circuitry, which can include the 
pixel selection circuitry, and bias current and reference voltage generation elements. 

[001 5] Block 1 1 0 includes the pixel readout circuitry, which may include the column 
readout circuitry, the gain circuits, and the A/D converter driving circuits. 

[001 7] The A/D conversion itself is carried out by block 1 20 which can include an array of 
A/D converters of any type, and may be successive approximation A/D converters, or 
other kinds as described herein. 

[001 8] The bias current and reference voltage generation block 140 produces specific 
voltages for operation of the pixel array. 

[0019] The control of the pixel array is effected by a timing and control data processing 
block 1 50. 

[0020] The system according to the present invention describes analysis of each of these 
blocks, to determine if power consumption can be reduced. 
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[0021] It is noted that in a CMOS image sensor, the pixel array 100 may produce 
relatively little power. However, the pixel readout circuitry 1 1 0 may itself may 
consume larger amount of power that can be managed. 

[0022] One aspect defines reading out the columns at high speed but low-power. 

[0023] Another aspect may separate the readout amplifier of the pixel into three separate 
amplification elements to respectively read out columns, apply gain, and apply signal 
drive to the A/D converter. Each of these elements may be separately optimized for 
the minimum performance requirements of the stages. 

[0024] A/D conversion by block 1 20 may be implemented using a pair of low-power, 
successive approximation, A/D converters. These may operate using overlapping 
timings. One of the A/D converters begins its conversion when the previous A/D 
converter is converting, e.g., halfway through its operation. In the embodiment, one of 
the A/D converters is applied only to data from the green pixels, and the other A/D 
converter receives data from the red and blue pixels. Therefore, any offset after 
calibration between the A/D converters may be masked by the inherent signal 
differences between the different color pixels. 

[0025] The bias current generation (block 140) generates bias currents through repeated 
current mirroring. In this system, bias current is minimized at all stages other than 
where it Is actually used by the circuitry. Voltage reference power consumption is 
primarily carried out in the buffering amplifiers that are used to drive the generated 
voltage into the analog circuitry. These amplifiers are also optimized to use the 
minimum power for their required operating conditions. The amplifier driving the 
column clamp voltage is also turned off when it is not being used. This may allow 
turning on the column clamp voltage over only about 5 percent of the operation cycle. 

[0026] 

The logic of timing and control/data processing is formed by digital logic gates. 
The power consumption of the logic is proportional to the total number of logic gates, 
multiplied by the frequency at which those gates are switched. The power 
consumption Is optimized by minimizing the switching of the gates. A gate that 
performs a specific function is switched only when that specific function is needed. 
For example, this system may only switch the pixel readout timing block during pixel 
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readout. 



[0027] The master clock controlling this logic may run faster than, e.g., six times the data 
rate. This makes it possible to reduce clock speed of all the data processing logic 
down to 1 /6 of the master clock rate. This may even further reduce the power. 

[0028] The analog circuitry may be subdivided, and separately optimized, as shown in the 
block diagram of figure 2. The block show includes the basic building blocks of the 
analog circuitry. This includes the sample and hold block 200 which acquires and 
holds the signals from the photo sensor array 199. Multiplexing block 210 may 
reduce the number of signals, which is output to the readout bus 220. The gain block 
230 may simplif/ these signals and apply them to A/D converter block 240. In 
addition, a bias current and voltage reference generation block 260 produces 
associated signals which are used as part of the conversion. 

[0029] In operation, the active pixel sensor is formed from an array of photoreceptors 
1 99. The array of photoreceptors has M rows and IM columns of pixels, where in 
general M and N can be the same or different numbers. The readout chain typically 
uses a column parallel architecture. An element is shown in figure 3. N parallel 
columns of signal processing circuitry are located on the chip, with one set of 
elements associated with each of the rows of the sensor. The circuitry indicative of the 
parallel columns is grouped according to functionality. In a typical circuit, each of the 
column circuits includes a sample and hold block 200, followed by a multiplexer block 
210. The sample and hold block 200 holds the signal, and may carry out various 
signal processing on the sample. The multiplexer block 210 serializes a full row of 
signals at a time onto the readout bus 220. Cain stage 230 amplifies the multiplexed 
output and analog to digital block 240 performs digital signal digitization of the 
amplified signal. Circuits are all set to their ideal operating conditions via biasing 
current and the voltage reference generation block 200. 

0030] sensor may be continuously read out, row by row, using a rolling shutter. 

During the readout of a specified row j, the signal and reset levels of the n pixels that 
belong to that row j are sampled by the sample and hold block 200 of the parallel 
column. Those pixels are then serialized by the multiplexer block 21 0 and sent to the 
gain 230 and A/D conversion block 240. The A/D conversion block 240 digitizes the 
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signals, and then a new row of pixels from the sensor is sampled into the sample and 
hold block, and the process repeats by serialization and digitization. The system 
hence converts a row at a time. 



[0031] The sample and hold block 200 is in actuality formed of N parallel columns of 
processing circuitry. Each column of processing circuitry matches to a column of 
pixels of the sensor 1 99. Figure 3 shows a single one of these columns of the sample 
and hold block as element 300. The sample and hold circuits include a set of crowbar 
switches 305 as well as an additional bias circuit 310 used for forming an active pixel 
bias. 

[0032] In operation, each input such as 299 represents a line from a specific column of 
pixels in the array. The array is controlled so that each line receives one pixel at a 
time. During readout, all of the pixels that belong to the selected row are sampled by 
closing appropriate switches. The switch 308 may be first closed in order to sample 
the level of reset onto the reset holding capacitor 307. Analogously, switch 303 may 
be closed to sample the signal level onto the capacitor 306. 

[0033] Those values are held on the capacitors 306, 307 for a specified time. During the 
time that the values are being held, specified switches 312,314 in the multiplexer are 
closed to connect the pair of sampled signals (signal and reset) to the readout bus. 
Once the signals are connected to the readout bus, the crowbar switches 305 are 
closed. This has the effect of forming an average between signal and reset, and also 
changing the charge value to a voltage value. Hence, operating the crowbar averages 
the signals, thereby providing a voltage value indicative of reset minus signal. 

[0034] The multiplexing block 210 may be a linear multiplexing circuit operating to 
multiplex the sampled voltage values into the readout bus. The circuit as shown in 
210 is actually a set of parallel switches including switch 312 and switch 314. Each 
switch connects a parallel column to the common readout bus 220. Each select switch 
is closed at an appropriate time by a signal generated by a column decoder that is 
controlled by the digital block. At each clock cycle, one pair of selects is connected to 
the readout bus, thereby allowing a serial readout of the sampled row of pixels. 



[0035] 



The multiplexer block sees parasitic capacitance to ground that is added from the 
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readout bus. This parasitic capacitance may originate from the multiplexer switches 
31 2, 31 4, A linear multiplexer for a CIF sized sensor may load the readout bus with 
parasitic capacitance to ground of a few picofarads. This capacitance may limit the 
performance of the gain block that is connected to the multiplexer block. 

[0036] An alternative embodiment may be used to reduce the parasitic capacitance. This 
alternative embodiment, shown in figure 4, uses a nested architecture having multiple 
selection levels. 

[0037] A first level, groups parallel columns together into groups of 1 6 elements. Each 

group of 16 elements is connected to a 16:1 multiplexer 402, Each of the 16-element 
multiplexers select one of the 1 6 inputs. This forms the first level of selection. There 
may be 24 of these 1 6 input multiplexer blocks receiving addresses, shown as o - j. 

[0038] The second level of selection is implemented by a multiplexer 403 with 24 inputs. 
The multiplexer 403 selects one of the outputs among the 24 that belong to the first 
level. 

[0039] The readout bus 220 connects the output of the multiplexer 210 to the input of 
the gain block 230 the performance of the gain block may be optimized if the 
parasitic capacitance to ground of the readout bus is carefully controlled. 

[0040] The gain block 230 preferentially differentially amplifies the information from the 
pixels. The differential amplification may enable rejection of and immunity against 
noise sources that are coupled into the power supply and ground. 

[0041 ] The variable gain may vary in the range from unity to a maximum value of around 
8. Gain granularity may be, for example, 1 /1 6 for a gain lower than 4, and 1/8 for 
gains between 4 and 8. 

[0042] 

For purpose of power optimization, the gain block may be subdivided into 
multiple stages. An initial stage 500 is a unity gain buffer stage. A final stage 510 may 
also be a unity gain buffer stage. The middle stage 505 may be a voltage gain stage. 
These multiple stages may decouple the parasitic capacitive load of the readout bus, 
which is originated from the multiplexer switches, from the gain stage inputs 
501 ,502. Similarly, the third stage 51 0 may be coupled to voltage gain stage outputs 
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506,507 from the variable capacitive load of the A/D converter. The actual gain stage 
505 therefore becomes isolated from any uncontrolled capacitive load both at input 
and output. Its performance can therefore be carefully optimized. 

[0043] Unbuffered, fully differential folded cascode amplifiers with common mode 

feedback may be used for the gain block. This specific amplifier technology may have 
advantageous power consumption and frequency stability. Each stage may include a 
reset element, 507, to reset the stage between operations. 

[0044] An alternative pipelined gain block is shown in figure 6a. The pipelining operation 
may relax the settling time requirements which may otherwise exist when a three 
stage gain block is used. In this embodiment, a two phase non overlapping clock may 
be used. The two phase clock is shown in figure 6b. Alternative phases are used for 
each stage of the gain block. At each of the clock cycles, a new column value is 
selected, and signal and reset values are sampled. It takes three clock cycles for the 
signal to reach the gain block output since intermediate sample and hold phases are 
present within each stage. 

[0045] The A/D converter block 240 may be embodied by two successive approximation 
A/D converters as described above. Figure 7 shows a specific A/D converter which 
may be used. An interlaced sampling scheme may effectively double the sampling rate 
of the A/D converter block as compared with the sampling rate of the single 
successive approximation A/D converter. This system may enable power saving it may 
reduce dissipation of static power. 

[0046] A voltage reference generation element 700 on chip may generate the reference 

voltage for the A/D converter. This reference voltage may be fully adjustable, and may 
allow the A/D converter's conversion range to be adjusted based on the signal range. 
A variable A/D converter reference provides additional signal gain before digitization. 
Each A/D converter uses an offset compensation scheme that allows calibration and 
removal of systematic offset at the A/D converter inputs. 

[0047] 

As an alternative system, other low-power A/D converters could be used in place 
of the successive approximation device. Other devices may have the advantage of 
further reduction of capacitance in the third stage of the readout circuit, thereby 
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allowing the power of that stage to be even further reduced. 

[0048] Figure 8 shows using current multiplication type digital to analog converter for the 
bias current and voltage reference generation block which produces bias currents for 
the amplifier. Digital to analog converter 81 0 mirrors a master current 800 into a 
current sources which are binary scaled according to bits 0 bit 7. A separate circuit 
820 may mirror according to a different binary value. 

[0049] Each of the mirrored currents MO M7 is either selected or not selected according 
to the respective bit 0-7. For example, if bit 0 is active, the mirrored current MO is 
passed, through transistor 81 1 , Transistor 81 1 has a width to length ratio of 4. 
Analogously bit 1 controls transistor 81 2, which has a width to length ratio of 2. Other 
bits control different transistors with different characteristics are shown in figure 8. 
The selected currents are summed as current IDAC by summary transistor 830 and 
mirrored to the desired circuit. 

[0050] Rather than generating the desired currents for each circuit in each current D/A 
converter, instead, the D/A converters are controlled to produce a 1 0 m A nominal 
current as their default setting. This current is mirrored into the amplifier according to 
a ratio. In this way, the bias voltages are generated with a very small total current, 
thus reducing the current generation power consumption. 

[0051] A voltage reference generation is performed by passing a nominal reference 
current 900, e.g. 1 00 m A, through a resistor division chain 905, to ground. This 
produces a series of voltages vref 1 5, vref 1 4, vref 1 3 ... at the connections between 
the resistors in the chain. These voltages can be selected by selecting the appropriate 
switch 901 , 902. Figure 9 shows how any of the voltages such as vref 1 5, can be 
selected by actuating one of the switches such as 901. The selected voltage from the 
closed switch is then passed to the appropriate circuit by buffer amplifier 91 0. 

[0052] 

Typically, three voltages are required to operate an active pixel sensor. These 
include the A/D converter reference voltage, the clamp voltage for pixel readout 
shown as VcLcol 346 in figure 3, and the common mode feedback voltage shown as 
Vcm 646 in figure 6. Often the clamp voltage and the common mode voltage are the 
same voltage and share of common buffer amplifier. However, load requirements on 
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these two voltages may be quite different. Therefore, a lower total power consumption 
may be obtained from using two separate amplifiers to produce the two different 
voltages. 

[0053] For example, the column clamp voltage often needs to drive a very large 

load caused by the 1 pf per column, times nine columns of the total device. This is 
only needed during the pixel sampling time, however. In contrast, the common mode 
voltage drives a much smaller load, but may be needed during the entire readout 
cycle. Therefore, the amplifier driving the clamp voltage may be turned off when it is 
not needed, 

[0054] Figure 1 0 shows a block diagram of the registers used for carrying out digital 
timing and control data processing logic. This device in a CMOS sensor may have a 
serial interface, D/A converter controller, integration timing calculator, pixel row read 
timing element, shutter reset timing, column readout control, data processing 
element, and calibration. Each of the different elements again may be separately 
optimized. For example, the serial interface is formed by a serial interface engine 
1 001 and an array of serial control registers 1 002. The serial interface is only clocked 
when the sensor detects a command from the serial bus. In a global sense, this may 
be a relatively rare event. The command from the serial bus may occur on average less 
than once per frame, and hence the expected average duty cycle for this logic will be 
less than one percent. 

[0055] D/A converter control may also be carried out by a D/A control block 1010. This 
element is only clocked at the beginning of each frame. In this way, the stored values 
within the D/A converters are clocked only at these times. At other times, no clocking 
is carried out. Once again, this may be a relatively rare event, and may occur less than 
the one percent duty cycle, 

[0056] Integration timing calculation is carried out by the block 1 020. This element may 
calculate roll addresses for readout and shutter reset. This block may only require 
clocking for a few clocked elements that the beginning of each row. Again, the duty 
cycle for this block may be less than one percent, thus further saving power. 

[0057] 

The pixel row read timing may also be controlled by element 1 030. The pixel row 
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read takes several microseconds at the beginning of each row. This block will be 
clocked only during that time. This may provide a total duty cycle less than 6 percent. 
Similarly, shutter reset timing 1040 controls reset of the pixels in the shutter row. 
This also requires a few microseconds during each row, and enables a duty cycle of 
less than 5 percent. 

[0058] Column readout control is controlled by element 1050. The column readout 

control generates the column addresses and triggers the A/D converters and readout 
amplifiers. This occupies the majority of the operational time. However, computations 
are only required at the pixel rate. The pixel rate is often several times slower the 
pixel rate, power consumption may be reduced by the ratio of the two clocks. 

[0059] Similarly, data processing logic only requires clocking at the pixel clock rate, not 
the master clock rate. Again, the data processing element may reduce power 
consumption according to the ratio of the two clocks. 

[0060] The signal path may typically be calibrated by performing simple calculations, e.g. 
averaging, on the data from the dark pixels surrounded the image collection area in 
the pixel array. The block of dark pixels may be clocked at the pixel clock rate. This 
only requires clocking during the readout of the dark rows. This can reduce the duty 
cycle to below 2 percent. Even further savings may occur if the pixels are clocked at 
the pixel rate instead of the master clock rate. 

[0061] Although only a few embodiments have been described in detail above, other 
modifications are possible, 

[0062] 
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